Skip to content

feat: agentic ai momentum tb endpoints#4051

Merged
epipav merged 10 commits intomainfrom
feat/agentic-ai-momentum-tb-endpoints
Apr 24, 2026
Merged

feat: agentic ai momentum tb endpoints#4051
epipav merged 10 commits intomainfrom
feat/agentic-ai-momentum-tb-endpoints

Conversation

@epipav
Copy link
Copy Markdown
Collaborator

@epipav epipav commented Apr 23, 2026

Note

Medium Risk
Adds new Tinybird scheduled COPY pipes and a Postgres replication/publication migration, which can impact data freshness and CDC behavior if misconfigured. Mostly analytics/reporting, but touches production DB replication settings and indexing.

Overview
Adds new Tinybird endpoints for Agentic AI momentum: scheduled daily COPY pipes that precompute collection-level “at a glance” metrics and per-project metrics into new agentic_ai_momentum_glance_ds and agentic_ai_projects_list_ds, plus thin query pipes (agentic_ai_momentum_glance.pipe, agentic_ai_projects_list.pipe) that expose the results.

Introduces a Tinybird collectionsRepositories datasource and a Postgres migration to set collectionsRepositories to REPLICA IDENTITY FULL, grant Sequin read access, conditionally add the table to sequin_pub, and add an ("updatedAt", id) index.

Fixes issue_analysis_copy_pipe.pipe to treat commentedAt = toDateTime(0) as NULL, and adds a scripts/push.sh helper to push Tinybird datasources first (optionally filtered via --match).

Reviewed by Cursor Bugbot for commit c5dc8a4. Bugbot is set up for automated code reviews on this repo. Configure here.

epipav added 6 commits April 23, 2026 12:28
Signed-off-by: anilb <epipav@gmail.com>
Signed-off-by: anilb <epipav@gmail.com>
Signed-off-by: anilb <epipav@gmail.com>
Signed-off-by: anilb <epipav@gmail.com>
Signed-off-by: anilb <epipav@gmail.com>
Signed-off-by: anilb <epipav@gmail.com>
Copilot AI review requested due to automatic review settings April 23, 2026 12:27
@github-actions
Copy link
Copy Markdown
Contributor

⚠️ Jira Issue Key Missing

Your PR title doesn't contain a Jira issue key. Consider adding it for better traceability.

Example:

  • feat: add user authentication (CM-123)
  • feat: add user authentication (IN-123)

Projects:

  • CM: Community Data Platform
  • IN: Insights

Please add a Jira issue key to your PR title.

@CLAassistant
Copy link
Copy Markdown

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
You have signed the CLA already but the status is still pending? Let us recheck it.

@github-actions
Copy link
Copy Markdown
Contributor

⚠️ Jira Issue Key Missing

Your PR title doesn't contain a Jira issue key. Consider adding it for better traceability.

Example:

  • feat: add user authentication (CM-123)
  • feat: add user authentication (IN-123)

Projects:

  • CM: Community Data Platform
  • IN: Insights

Please add a Jira issue key to your PR title.

@github-actions
Copy link
Copy Markdown
Contributor

⚠️ Jira Issue Key Missing

Your PR title doesn't contain a Jira issue key. Consider adding it for better traceability.

Example:

  • feat: add user authentication (CM-123)
  • feat: add user authentication (IN-123)

Projects:

  • CM: Community Data Platform
  • IN: Insights

Please add a Jira issue key to your PR title.

1 similar comment
@github-actions
Copy link
Copy Markdown
Contributor

⚠️ Jira Issue Key Missing

Your PR title doesn't contain a Jira issue key. Consider adding it for better traceability.

Example:

  • feat: add user authentication (CM-123)
  • feat: add user authentication (IN-123)

Projects:

  • CM: Community Data Platform
  • IN: Insights

Please add a Jira issue key to your PR title.

Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Adds Tinybird data pipelines and API-facing pipes to support “Agentic AI” collection momentum + project list endpoints, including a new junction datasource (collectionsRepositories) and a DB migration to enable replication.

Changes:

  • Introduces copy pipes + datasources to precompute Agentic AI “projects list” and “momentum at-a-glance” metrics on a daily schedule.
  • Adds API pipes that expose those precomputed datasources with client-friendly snake_case fields.
  • Adds collectionsRepositories Tinybird datasource and a backend migration to support replication/indexing, plus a helper push.sh script.

Reviewed changes

Copilot reviewed 10 out of 11 changed files in this pull request and generated 7 comments.

Show a summary per file
File Description
services/libs/tinybird/scripts/push.sh Script to push datasources/pipes via tb push with optional filename matching.
services/libs/tinybird/pipes/issue_analysis_copy_pipe.pipe Adjusts commentedAt handling in issue analysis copy pipe.
services/libs/tinybird/pipes/agentic_ai_projects_list_copy.pipe Daily copy pipe to compute per-project metrics for the Agentic AI collection.
services/libs/tinybird/pipes/agentic_ai_projects_list.pipe API pipe selecting/renaming fields from agentic_ai_projects_list_ds.
services/libs/tinybird/pipes/agentic_ai_momentum_glance_copy.pipe Daily copy pipe to compute at-a-glance collection metrics (contributors, medians, etc.).
services/libs/tinybird/pipes/agentic_ai_momentum_glance.pipe API pipe selecting/renaming fields from agentic_ai_momentum_glance_ds.
services/libs/tinybird/datasources/collectionsRepositories.datasource New replicated junction datasource for collection ↔ repository membership.
services/libs/tinybird/datasources/agentic_ai_projects_list_ds.datasource Storage schema for precomputed per-project Agentic AI metrics.
services/libs/tinybird/datasources/agentic_ai_momentum_glance_ds.datasource Storage schema for precomputed at-a-glance Agentic AI metrics.
backend/src/database/migrations/V1776939912__collectionRepositoriesReplicaIdentityUpdates.sql Adds replica identity/grants/indexes for collectionsRepositories replication support.
backend/src/database/migrations/U1776939912__collectionRepositoriesReplicaIdentityUpdates.sql Undo migration placeholder (empty).

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread services/libs/tinybird/pipes/agentic_ai_projects_list_copy.pipe Outdated
Comment thread services/libs/tinybird/pipes/agentic_ai_projects_list_copy.pipe Outdated
Comment thread services/libs/tinybird/pipes/agentic_ai_projects_list_copy.pipe
Comment thread services/libs/tinybird/pipes/agentic_ai_projects_list_copy.pipe
Comment thread services/libs/tinybird/pipes/agentic_ai_momentum_glance_copy.pipe Outdated
Comment thread services/libs/tinybird/pipes/agentic_ai_momentum_glance_copy.pipe
Comment thread services/libs/tinybird/pipes/agentic_ai_projects_list_copy.pipe
@epipav epipav requested a review from gaspergrom April 23, 2026 12:38
gaspergrom
gaspergrom previously approved these changes Apr 23, 2026
epipav added 2 commits April 24, 2026 11:13
Signed-off-by: anilb <epipav@gmail.com>
…owdDotDev/crowd.dev into feat/agentic-ai-momentum-tb-endpoints
@github-actions
Copy link
Copy Markdown
Contributor

⚠️ Jira Issue Key Missing

Your PR title doesn't contain a Jira issue key. Consider adding it for better traceability.

Example:

  • feat: add user authentication (CM-123)
  • feat: add user authentication (IN-123)

Projects:

  • CM: Community Data Platform
  • IN: Insights

Please add a Jira issue key to your PR title.

Signed-off-by: anilb <epipav@gmail.com>
Copilot AI review requested due to automatic review settings April 24, 2026 09:23
@github-actions
Copy link
Copy Markdown
Contributor

⚠️ Jira Issue Key Missing

Your PR title doesn't contain a Jira issue key. Consider adding it for better traceability.

Example:

  • feat: add user authentication (CM-123)
  • feat: add user authentication (IN-123)

Projects:

  • CM: Community Data Platform
  • IN: Insights

Please add a Jira issue key to your PR title.

Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 10 out of 11 changed files in this pull request and generated 4 comments.


💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread services/libs/tinybird/pipes/agentic_ai_projects_list_copy.pipe
Comment thread services/libs/tinybird/pipes/agentic_ai_projects_list.pipe
Comment thread services/libs/tinybird/scripts/push.sh
Comment thread services/libs/tinybird/pipes/agentic_ai_projects_list_copy.pipe
Copy link
Copy Markdown

@cursor cursor Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cursor Bugbot has reviewed your changes and found 1 potential issue.

Fix All in Cursor

❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, have a team admin enable autofix in the Cursor dashboard.

Reviewed by Cursor Bugbot for commit c5dc8a4. Configure here.

Comment thread services/libs/tinybird/pipes/agentic_ai_projects_list_copy.pipe
@epipav epipav merged commit ca7032a into main Apr 24, 2026
20 checks passed
@epipav epipav deleted the feat/agentic-ai-momentum-tb-endpoints branch April 24, 2026 11:10
skwowet pushed a commit that referenced this pull request Apr 28, 2026
Signed-off-by: anilb <epipav@gmail.com>
Signed-off-by: Yeganathan S <63534555+skwowet@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants